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Abstract. We investigate the convergence rates of the trajectories generated by implicit 
first and second order dynamical systems associated to the determination of the zeros of 
the sum of a maximally monotone operator and a monotone and Lipschitz continuous one 
in a real Hilbert space. We show that these trajectories strongly converge with exponential 
rate to a zero of the sum, provided the latter is strongly monotone. We derive from here 
convergence rates for the trajectories generated by dynamical systems associated to the 
minimization of the sum of a proper, convex and lower semicontinuous function with a 
smooth convex one provided the objective function fulfills a strong convexity assumption. 
In the particular case of minimizing a smooth and strongly convex function, we prove that 
its values converge along the trajectory to its minimum value with exponential rate, too. 
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backward method, convergence rates, convex optimization problems 

AMS subject classification. 34G25, 47J25, 47H05, 90C25 

1 Introduction and preliminaries 

The main topic of this paper is the investigation of convergence rates for implicit dynamical 
systems associated with monotone inclusion problems of the form 

find X* such that 0 G Ax* + Bx*, (1) 

where R is a real Hilbert space, A : R ^ R is a maximally monotone operator, R : R —)• R 
is a monotone and ^-Lipschitz continuous operator for /3 > 0 and A -|- R is p-strongly 
monotone for p > 0. Dynamical systems of implicit type have been already considered in 
the literature in [HEIITIEIIIIIIIIHIT]. 

We deal in a first instance with the first order dynamical system with variable relax¬ 
ation parameters 
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where xq G Ti, X : [0, +oo) ^ [0, oo) is a Lebesgue measurable function and Jr^A denotes 
the resolvent of the operator rjA for ry > 0. 

We notice that Abbas and Attouch considered in [H Section 4.2] the dynamical system 
of same type 


f x{t) + x{t) = prox^^ {x{t) - ^iB{x{t))) 
\ x(0) = xo 


(3) 


in connection to the determination of the zeros of 5$ + B, where —)• M U {+ 00 } is 

a proper, convex and lower semicontinuous function, B :'H ^ Ti is a cocoercive operator, 
54? denotes the convex subdifferential of and prox^^ denotes the proximal point operator 
of /i4>. 

Before that, Antipin in [7] and Bolte in [T3] studied the convergence of the trajectories 
generated by 

f x{t) + x{t) = Pc{x{t) - nVg{x{t))) , 

\ x( 0 ) = Xo ^ 

to a minimizer of the smooth and convex function g : Ti ^ M. over the nonempty, convex 
and closed set C C Ti, where g > 0 and Pc denotes the projection operator on the set C. 

In the second part of the paper we approach the monotone inclusion ([1]) via the second 
order dynamical system with variable damping and relaxation parameters 


+ X{t) x{t) - JnA[x{t) - r]B{x 
x( 0 ) = = Xo, 


= 0 


(5) 


where uq, vq G Ti, X : [0, +00) —[0, 00) and 7 : [0, +00) —>■ [0, 00) are Lebesgue measurable 
functions, and ry > 0 . 

Second order dynamical systems of the form 


( x{t) + 7 x(t) + x(t) — Tx{t) = 0 
\ x( 0 ) = no,x( 0 ) = Xo, 


for 7 > 0 and T ■. TL ^ % a nonexpansive operator, have been treated by Attouch and 
Alvarez in [ 8 ] in connection to the problem of approaching the fixed points of T. 

For the minimization of the smooth and convex function g : P ^ M over the nonempty, 
convex and closed set C C P, a continuous in time second order gradient-projection 
approach has been considered in m, having as starting point the dynamical system 


f x{t) + 7 x(f) -b x{t) - Pc{x{t) - gS/g{x(t))) = 0 
\ x( 0 ) = xo,x( 0 ) = Xo, 


with constant damping parameter 7 > 0 and constant step size ry > 0 . 

For an exhaustive asymptotic analysis of the first and second order dynamical systems 
([2|) and ([5]), in case B is cocoercive, we refer the reader to |15] and m, respectively. 
According to the above-named works, one can expect under mild assumptions on the 
relaxation and, in the second order setting, on the damping functions, that the generated 
trajectories converge to a zero of A B. The main scope of this paper is to show that 
when weakening the assumptions on B to monotonicity and Lipschitz continuity, however, 
provided that A + B is strongly monotone, the trajectories converge strongly to the unique 
zero of A + B with an exponential rate. Exponential convergence rates have been obtained 
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also by Antipin in [7] for the dynamical systems (|3|) and ([7|), by imposing for the smooth 
function g supplementary strong convexity assumptions. 

We transfer the results obtained for both first and second order dynamical systems to 
optimization problems of the form 


min f{x)+g{x), (8) 

where f ^ MU{+oo} is a proper, convex and lower semicontinuous function, g ■.% 
is a convex and (Frechet) differentiable function with ^-Lipschitz continuous gradient for 
/3 > 0 and f + g is p-strongly convex for p > 0 , by taking into consideration that its set of 
minimizers coincides with the solution set of the monotone inclusion problem 

find X* such that 0 G df{x*) + Vg{x*). 

When further particularizing this context to the one of solving minimization problems like 

min g{x), (9) 

xGH 

where g : Ti ^ M. is a p-strongly convex and (Frechet) differentiable function with 
Lipschitz continuous gradient for p > 0 and /3 > 0, we show that the values of g converge 
along the trajectories generated by the corresponding first and second order dynamical 
systems to its minimum value also with exponential rate. 

The rest of this section is devoted to some notations and definitions used in the paper. 
We denote by a real Hilbert space with inner product (•, •) and corresponding norm 
II ■ II = (■) ■)• For an arbitrary set-valued operator A : H ^ H we denote by Gr A = 

{{x,u) G Ti X 7i : u G Ax} its graph. We use also the notation zer A = {x GTi : 0 G Ax} 
for the set of zeros of A. We say that A is monotone, if {x — y,u — v) > 0 for all 
(x,n), {y,v) G Gr A. A monotone operator A is said to be maximally monotone, if there 
exists no proper monotone extension of the graph oi A on % x %. The resolvent of A, 
Ja : Ti ^ Ti, is defined by Ja = (Id+A)“^, where Id : H ^ H denotes the identity 
operator on %. If A is maximally monotone, then Ja '■ Ti. ^ % is single-valued and 
maximally monotone (see m Proposition 23.7 and Corollary 23 . 10 ]). For an arbitrary 
7 > 0 we have (see m Proposition 23 . 2 ]) 

p G J^AX if and only if {p,j~^{x — p)) G Gr A. (10) 

The operator A is said to be p-strongly monotone for p > d, ii {x — y,u — v) > p\\x — y\\^ 
for all (x, u), {y, v) G Gr A. 

As in TO, we consider the following definition of an absolutely continuous function. 

Definition 1 (see, for instance, [2l[T2]) A function x : [0, 6 ] —)• (where 6 > 0) is said to 
be absolutely continuous if one of the following equivalent properties holds: 

(i) there exists an integrable function y : [0,b] ^ T-L such that 

x(t) = x(0) -I- [ y{s)ds VtG[0,6]; 

Jo 

(ii) X is continuous and its distributional derivative is Lebesgue integrable on [0,6]; 
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(iii) for every e > 0 , there exists r] > 0 such that for any finite family of intervals 
Ik = {o^kilk) ^ [ 0 , 6 ] we have the implication 

I 4 n /j- = 0 and ^ | 6 fc - afcl < T/ 1 ^ ^ \\x{hk) - x{ak)\\ < e. 

\ k / k 

Remark 1 (a) It follows from the definition that an absolutely continuous function is 
differentiable almost everywhere, its derivative coincides with its distributional derivative 
almost everywhere and one can recover the function from its derivative x = y hy the 
integration formula (i). 

(b) If X : [0,6] — H, where 6 > 0, is absolutely continuous and B : ^ is L- 

Lipschitz continuous for L > 0 , then the function z = B o x is absolutely continuous, too. 
This can be easily seen by using the characterization of absolute continuity in Definition 
[T][iii). Moreover, z is differentiable almost everywhere on [ 0 , 6 ] and the inequality lli(t)ll < 
holds for almost every t G [ 0 , 6 ]. 


2 Converges rates for first order dynamical systems 


The starting point of the investigations we carry out in this section is the first order 
dynamical system (l 2 |) that we formulated in relation to the monotone inclusion problem 
(HD- We say that x : [0,+oo) —)■ 4 is a strong global solution of ([2]), if the following 
properties are satisfied: 

(i) x : [ 0 , +oo) —)• 4 is locally absolutely continuous, that is, absolutely continuous on 
each interval [ 0 , 6] for 0 < 6 < +oo; 

(ii) For almost every t G [0,+oo) it holds x{t) = X{t) — r]B{x{t))^ — x{t) ; 

(iii) x(0) = xq. 

The existence and uniqueness of strong global solutions of the system ([2]) follow from 
the Cauchy-Lipschitz-Picard Theorem, by noticing that the operator T = 4^0 (Id —yB) — 
Id is Lipschitz continuous (see also m Section 2]). 

The following result can bee seen as the continuous counterpart of m Proposition 
25.9], where it is shown that the sequence iteratively generated by the forward-backward 
algorithm linearly converges to the unique solution of ([T]), provided that one of the two 
involved operators is strongly monotone. 


Theorem 2 Let A :'H be a maximally monotone operator, B :'H ^ B a monotone 
and ^-Lipschitz continuous operator for /3 > 0 such that A + B is p-strongly monotone for 
p > 0 and X* be the unique point in zer(^ -|- B). Let A : [0, + 00 ) —>■ [0, + 00 ) be a Lebesgue 
measurable function such that there exist real numbers A and A fulfilling 

0 < A < inf X{t) < supA(t) < A. 

t>o 


Chose a > 0 and y > 0 such that 


a < 2pj3^X and 7 ; + — < pi —. 

p 2a y 


4 




If xq G H and x : [0, +oo) % is the unique strong global solution of the dynamical 
system ([2]), then for every t E [0, + 00 ) one has 

||x(t) — < ||xo — x*||^exp(—Ct), 

where C := f > 0. 

Proof. Notice that i? is a maximally monotone operator (see |13l Corollary 20.25]) and, 
since B has full domain, ^ + i? is maximally monotone, too (see [131 Corollary 24.4]). 
Therefore, due to the strong monotonicity oi A + B, + i?) is a singleton (see [131 

Corollary 23.37]). 

A direct consequence of ([2]) and of the definition of the resolvent is the inclusion 


g\{t) 


x{t) — B{x(t)) + B 


Mty 


x{t) + x{t) ] G {A + B) 


m 


x{t) + x{t) , 


which holds for almost every t G [0,+oo). Combining it with 0 € (A + B){x*) and the 
strong monotonicity of A + i?, it yields for almost every t E [0, + 00 ) 


P 


1 


X{t) 

1 


x{t) + x{t) — x'* 


< 


1 


x{f) + x{t) — X* , - —-^x{t) — B{x{t)) + B 


X{t) 


x{t) + x{t) 


X{t) riX{t) 

By using the notation h{t) = \\\x{t) — for t G [0,+oo), the Cauchy-Schwartz 
inequality, the Lipschitz property of B and the fact that h{t) = {x{t) — x*,x{t)), we 
deduce that for almost every t G [0, + 00 ) 


X{t) 


x{t) + x{t) — X* 


<- 


1 


r]X^{t) 

1 


+ 


1 /. 


m\ 


x{t), B I -——x{t) + x{t) — B{x{t)) 


< - 


riX{t) 
1 


h{t) + ( x{t) — X* ,B 


X{t) 


X{t) 


x{t) + x{t) ] - B{x{t)) 


+ 


1 


r]X^{t) 

+ ^ w.N ll^(^) “ ^*1111^ 


/?A2(t) 


< - 


+ 


mr' 

1 

'qX^{t) 

a 

Wm 


+ 


1 


fix\t) 


|x(t)f- 


|x(t)f- 


ryA(f) 


r?A(t) 


hit) 


hit) 


hit) + 


1 


As 


m 


xit) + xit) — x* 


2aA(t) 
P II ■ 


m' 


^ + -r^Ht) + ‘^pHt), 


we obtain for almost every t G [0, + 00 ) the inequality 


2p 1 

+ 


Xit) rjXit) 
^ T ' 


hit) + I 2p — 


a 


P^Xit) 

1 


X'^it) pX^it) PX^it) 2aA(t) 


Xit) 

h(t)+ 

|x(t)f <0. 
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However, the way in which the involved parameters were chosen imply for almost every 
t E [0, +oo) that 


2p 


+ 


1 


A(t) r]X{t) 


h{t) + [2p - 


a 




h{t) < 0 


or, equivalently. 


This further implies 


2pX{t) — ^ 

h{t) H-— h{t) < 0. 


h{t) + Ch{t) < 0 


for almost every t E [0, +oo). By multiplying this inequality with exp(Ct) and integrating 
from 0 to T, where T > 0, one easily obtains the conclusion. ■ 


We come now to the convex optimization problem ([8]) and notice that, since argmin(/+ 
g) = zer((9(/ + g)) = zer(5/ + Vg), one can approach this set by means of the trajectories 
of the dynamical system (l2|) written for A = df and B = Vg. Here, df :'H defined 

by 

df{x) = {u£'H: f{y) > f{x) + {u,y - x) Vy E H}, 

if f{x) E M and df{x) = 0, otherwise, denotes the convex subdifferential of /, which is a 
maximally monotone operator, provided that / is proper, convex and lower semicontinuous 
(see [22]). We notice that, for r/ > 0, the resolvent of pdf is given by = prox^j 
(see m), where prox^j : B ^ B, 


piox f{x) = argmin 
y&H 




( 11 ) 


denotes the proximal point operator of pf. This being said, the dynamical system (1^ 
becomes 


x{t) = X{t) 

x(0) = Xq. 


proKjjf 


yx{t) — pV g{x 


x{t) 


( 12 ) 


The following result is a direct consequence of Theorem [2j Let us also notice that f + g 
is said to be p-strongly convex for p > 0, if / + y — ^|| • |p is a convex function. In 
this situation d{f + g) = 5/ + Vy is a y-strongly monotone operator (see [T3l Example 
22.3(iv)].) 


Theorem 3 Let f : — )• M U {+oo} be a proper, convex and lower semicontinuous 
function, y ; —)• M 6e a convex and (Frechet) differentiable function with ^-Lipschitz 
continuous gradient for /3 > 0 such that f + g is p-strongly convex for p > 0 and x* be the 
unique minimizer of f + g over B. Let X : [0, +oo) —)• [0, +oo) be a Lebesgue measurable 
function such that there exist real numbers X and X fulfilling 

0 < A < inf X{t) < supA(t) < A. 

t>o 


Chose a > 0 and p > 0 such that 


1 


A 


a < 2/9WA and — H-< P + 

p 2a 


1 

p’ 
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If xq G H and x : [0, +oo) % is the unique strong global solution of the dynamical 
system (m, then for every t G [0. + oo) one has 

\\x{t) — x*\\‘^ < ||xo — X*Ip exp(—Ct), 

where C := ——f- > 0. 

2p+- 

In the last part of this section we approach the convex minimization problem Q via 
the first order dynamical system 


f x{t) + \{t)Vg{x{t)) = Q 
\ x(0) = Xq. 


The following result quantifies the rate of convergence of g to its minimum value along 
the trajectories generated by (fT^ . 


Theorem 4 Let g : It —)■ M be a p-strongly convex and (Frechet) differentiable function 
with ^-Lipschitz continuous gradient for p > 0 and /3 > 0 and x* be the unique minimizer 
of g overH. Let A : [0, +oo) ^ [0, +oo) be a Lebesgue measurable function such that there 
exists a real number A E M fulfilling 


0 < A < inf X(t). 

~ t>o 

Chose a > 0 such that 

a < 2\(5p^. 

If Xq G H and X : [0, +oo) -G- H is the unique strong global solution of the dynamical 
system (ini), then for every t G [0, +oo) one has 

0 < ^\\x{t)-x*\\‘^ < g{x{t))-g{x*) < {g{xo)-g{x*)) exp{-at) < ^||xo-x*|p exp(-at). 

Proof. The second inequality is a consequence of the strong convexity of the function 
g. Further, we recall that according to the descent lemma, which is valid for an arbitrary 
differentiable function with Lipschitz continuous gradient (see m Lemma 1.2.3]), we have 

g{u) < g{v) + {Vg{v),u “ + ^11“ “ ^11^ v gH. 

By setting in the previous relation, for every t G [0,+oo), u := x{t) and v := x* and by 
taking into account that Vg{x*) = 0, we obtain 

g{x{t)) - g{x*) < - x*|p. (14) 

From here, the last inequality in the conclusion follows automatically. 

Using the strong convexity of g we have for every t G [0, +oo) that 

p\\x{t) - < {x{t) - x*,Vg{x{t))) < \\x{t) - x*||||V 5 ((x(t))||, 

thus 

p||x(t)-x*|| < ||V5-(x(t))||. (15) 
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Finally, from the first equation in (I13p . (|14p . (1151) and using the way in which a was chosen, 
we obtain for almost every t E [0, +oo) 


^(g(x(t)) - g(x*)) -ha(g(x(t)) -g(x*)} = (x(t),Vg(x(t))} + a(g(x(t)) - g(x*}) 

<-A(t)llVg(x(t))f + ^llx(t)-x*f 

<(-A(i) + ^) ||V5(x(t))f 

< 0 . 

By multiplying this inequality with exp(at) and integrating from 0 to T, where T > 0, 
one easily obtains also the third inequality. ■ 


3 Converges rates for second order dynamical systems 


The starting point of the investigations we go through in this section is again the monotone 
inclusion problem ([ 1 ]), however, this time approached via the second order dynamical 
system ([5]). We say that x : [0, +oo) —)• is a strong global solution of ([5]), if the following 
properties are satisfied: 

(i) X, X : [0, +oo) —)• % are locally absolutely continuous; 

(ii) For almost every t E [0, +oo) it holds 


x{t) + 7 (t)x(t) + \{t) x{t) — JnA\x{t) - gB{x 


= 0 ; 


(hi) x(0) = no,x(0 ) = uq. 

The existence and uniqueness of strong global solutions of the system ([5]) follow from 
the Cauchy-Lipschitz-Picard Theorem applied in a product space (see also m)- 
The following result will be useful when deriving the convergence rates. 


Lemma 5 Let h,'y,bi,b 2 ,b 3 ,u : [0,+oo) ^ M 6 e given functions such that h,'y^b 2 ,u are 
loeally absolutely continuous and h is locally absolutely continuous, too. Assume that 

h{t), b 2 {t),u{t) > 0 Vt E [0, +oo) 

and that there exists 7 > 1 such that 

j{t) > 7 > 1 Vt E [0, + 00 ). 

Further, assume that for almost every t E [0, + 00 ) one has 

lit) + ^{t) < bi{t) + I, (16) 


b2it) + b2{t) < bsit) (17) 

and 

'h{t) + l{t)h{t) + bi{t)h{t) + b 2 {t)u{t) + bs{t)u{t) < 0 . (18) 

Then there exists M > 0 sueh that the following statements hold: 





(i) i/ 1 < 7 < 2, then for almost every t E [0, +oo) 


0 < h{t) < (^h{ 0 ) + exp(-(7 - l)t); 

(a) i/ 2 < 7, then for almost every t E [ 0 , +oo) 

M ( M \ 

0 < hit) < hit)) exp(—(7 — l)t) H-exp(—i) < ( hiO) -\ -) exp(—t) 

7-2 V 7-2/ 

(Hi) 2/7 = 2, then for almost every t E [ 0 , +00) 

0 < h{t) < {h{ 0 ) + Mt) exp(—t). 

Proof. We multiply the inequality (fT8]l with exp(t) and use the identities 

exp{t)'h{t) =—(exp(t)/i(t)) — exp{t)hit) 
exp{t)u{t) =—{exp{t)u{t)) — ex.p{t)u{t) 
exp{t)h{t) =—(exp(t)/i(t)) — exp{t)h{t) 
in order to derive for almost every t E [ 0 , +00) the inequality 
^(exp(t)/i(t)) + (7(t) - l)^(exp(t)/i(t)) + 

exp{t)h{t){bi{t) + 1 - 7(t)) + b2it)-^{exp{t)u{t)) + (bait) - b2{t)) exp{t)u{t) < 0 
By using also 

(lit) - l)^(exp(t)/i(t)) = ^((tW - l)exp(t)/i(t)) -7(t)exp(t)/i(t) 
b2it)-^(^exp{t)u{t)) = ^(b2it) exp{t)u{t)) - b2it) exp{t)u{t) 
we obtain for almost every t E [ 0 , +00) 

^(exp(t)/i(t)) + - 1 ) exp{t)h{t)^ + ^{b2{t) exp{t)u{t)) + 

(61 (t) + 1 - 7(t) - 7(t)) exp{t)h{t) + (63(f) - 62(f) - 62(f)) exp(f)ti(f) < 0. 
The hypotheses regarding the parameters involved imply that the function 
f —>■ exp(f)/i(f) + (7(f) — 1) exp(f)/i(f) + 62(f) exp(f)M(f) 
is monotonically decreasing, hence there exists M > 0 such that 

exp(f)/i(f) + (7(f) — 1) exp(f)/i(f) + 62(f) exp(f)ri(f) < M. 
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Since u{t), 62 (i) > 0 we get 

h{t) + ( 7 (t) — l)h{t) < M exp(—t), 

hence 

h{t) + (7 — l)h(t) < Mexp(—t) 
for every t G [ 0 , +00). This implies that 

^(exp((7- < Mexp((7 - 2)t), 

for every t G [ 0 , +00), from which the conclusion follows easily by integration. ■ 

We come now to the first main result of this section. 


Theorem 6 Let A : LL ^ LL be a maximally monotone operator, B :'H ^ LL a monotone 
and ^-Lipschitz continuous operator for /3 > 0 such that A + B is p-strongly monotone for 
p > 0 and X* be the unique point in zer(A + B). Chose a, (5 G (0,1) and r/ > 0 such that 

5Pp < 1 and I = (^ + 1 - P > 0. 

Let A : [0, + 00 ) — )• [0, + 00 ) be a locally absolutely continuous function fulfilling for 
every t G [0, + 00 ) 


e{t) := X{t) 


< m 




1-6 


1 T 

P ' A.pP'^a 


2p{l - a) 


(;! + 4 ^) 


+ X\t) 


2/9(1 - a) 


f+ (f + 


1 

4pp'^a J S 


and such that there exists a real number X with the property that 


0 < A < inf X{t) 
~ t>o 


and 


2<e-.= x 


5 ^ + 4p/3^a) I 


l-(5 


i T 

P ' ApP'-^a 


Further, let 7 : [ 0 , +00) [ 0 , +00) be a locally absolutely continuous function fulfilling 

- for every t G [ 0 , +00) ( 19 ) 


l + pi + mt) ^ ^ j 2 p(l - a) 


p+ (j + 


ApP‘‘a j 6 


and 


j{t) < 0 and 


d (j{t) 


< 0 for almost every t G [ 0 , +00). 


( 20 ) 


dt \X{t) ^ 

Let no, no G Ti and x : [ 0 ,+00) B be the unique strong global solution of the dynamical 
system ©• 
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Then 'y{t) > 7 ;= > 2 for every t G [ 0 , +00) and there exists M > 0 such that 

for every t G [0, +00) 


M 


0 < \\x{t) — X* If < ||no — X* If exp(—(7 — l)t) H-- exp(—t) 


7-2 


— ( ll'^^o ~ 3:*Ip + 


M 

7^ 


exp(—t). 


Proof. From the definition of the resolvent we have for almost every t G [ 0 , +00) 


( 21 ) 


We combine this with 0 G (A + B)x*, the strong monotonicity of A + B, the Lipschitz 
continuity of B and, by also using the Cauchy-Schwartz inequality, we get for almost every 
t G [ 0 , -|-oo) 


2p 


7^ i|x(t) + 7(t)x(t)||^ + ^ {x{t) - x*,x{t) + 'y{t)x{t)) + p\\x{t) - 


=P 


< 




1 




m ^ ^ Ht) 


1 


lit) 


^(t) + TTr^Ht) + xit) - x*,B . ---x(t) + 77-x(t) + x{t) - B{x{t)) 


m ^ ' Ht) 


+ ^i{() + x{t) - x", + ^i(«) 


1 


1 


lit)-, 


i^xit) + j{t)x{t),B [j^x{t) + J^x{t) + x{t) j - B{x{t)) 
+ (^x{t) - x*,B (^-^Ht) + “ ^i^it)) 

"x{t)+i{t)x{t)f - (x(t) -xfx(t) +7(t)x(t)) 


7 ]X{t) 


rjX^ft) 

< - - ■ \\xit) + lit)xit)f -+ lit)x^^^"‘^ 


-(3X^{t) 

+ 


rjX^{t) 


4^/g2^_^2(^) ll^(^) + lit)^it)f + pOi\\xit) i^i^) ~ x\xit) + -iit)x{t)) . 


Using again the notation h{t) = A||x(t) — x*|p, we have for almost every t G [ 0 , +00) 


and 


|x(f)+7(t)x(t)f = ||x(t)f+ 7^(t)||x(t)f+ 


(x(t) — x* ,x{t) + 7(t)x(t)) = 'h{t) + 'y{t)h{t) — ||x 


( 22 ) 
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Therefore, we obtain for almost every t G [0, +oo) 


^ 


X^it) PX^it) 4:pl3‘^aX^{t) 




+ 


7^(t) 


" + ' 


1 


1 


2p 


1 


+ 7(f) 


A^(f) pX^{t) /3X^{t) 4:pl3^aX^{t) J X{t) pX{t) 

p 1 1 1 \ d 

+ 


+ 


(IP. 


X^{t) p\^{t) (dX?{t) Ap(d‘^aX^{t) J dt 

1 


X 


0 


+ 


VA(f) pX{t) 

The hypotheses imply that 




h{t) + 7 (f) 


2p 1 

+ 


A(f) pX{t) 


h{t) + 2 p(l — a)h{t) < 0 . 


X‘^{t) pX^{t) f3X‘^{t) 4p/32aA2(f) X‘^{t) 


1 1 


1 


r/ /3 Ap/d^a 


> 0 , 


hence the first term in the left hand side of the above inequality can be neglected and we 
obtain for almost every t G [0, +oo) that 


where 


hit) ++ biit)h{t) +^2(0^(11^(011^) + (J3(0II'^’(*'"^ 


0(0 :=A(0^dl^>o 

P ' Tj 

P I 1_1_ 1 r^\ n-L 1 - I 

A^(i) ' 7]X‘^{t) ^A^(t) 4p/3^QA^(t) P ' rj (3 


< 0 , 


(23) 


b2{t) ■■= 7(f) 


1 

4p/3^a 


I 1 

\{t) rj\(t) 


A(f) 


^p + h 


> 0 


and 


.v2/'/'i f P I 1_1_ 1 ^ _ _2p_ ]_ 

&3 f := -^^- 


2p 1 


\(t) ^ TjXij.) 

This shows that (jlSp in Lemma [5] for u := ||x(-)|P is fulfilled. In order to apply Lemma O 
we have only to prove that (jl 6 |) and (|17p are satisfied, as every other assumption in this 
statement is obviously guaranteed. 

A simple calculation shows that 


h{t) > b2{t) 7^(f) - 7(f) > 


2p 1 


X(t) ^ ri\{t) 


P I 1_1_ 1 

rjX^it) PX\t) ApP'^aX^(t) 


= e{t), 


(24) 


which is true according to (fT^ . thus 63 (f) > 62 (f) for every f G [0,+oo). On the other 
hand (see ([ 20 ])), 

62 (f) < 0 

for almost every f G [0, + 00 ), from which ()17p follows. 

Further, again by using (fTop . observe that 


1 + 61 (f) — 1 + A(f) 


2 p(l - a) 


PX 47 ^) I 


> 7(f) 
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for every t G [ 0 ,+00), which, combined with 

iit) < 0 

for almost every t G [0,+ 00 ), shows that (fT 6 ]l is also fulfilled. 

The conclusion follows from Lemma [5{ii), by noticing that 7 > 2 , as0>2. ■ 


Remark 7 One can notice that when 7(t) < 0 for almost every t G [ 0 , +00), the second 
assumption in (f2U|l is fulfilled provided that A(f) > 0 for almost every t G [ 0 , +00). 

Further, we would like to point out that one can oviously chose A(f) = A and 7 (t) = 7 
for every t G [ 0 , +00), where 


and 


2 < 0 := A 


6 0 + + 4^^) I 

1 — (5 4 + ■ L 

0 4p0^a 


<A— 


2 p(l - a) 


. 0 + U + 4 ^) 


1 + Vl + 40 


< 7 < 1 + A 


2 p(l - a) 


0 + (:^ + 4^) 1 


When considering the convex optimization problem ([ 8 |), the second order dynamical 
system ([5]) written for A = df and B = 'Vg becomes 


x{t) + 7 (f)x(f) + X{t) x{t) — — r]Vg{x 

x(0) = uo,x(0) = Vq. 


= 0 


(25) 


Theorem [ 6 ] gives rise to the following result. 


Theorem 8 Let f : — )• M U {+00} be a proper, convex and lower semicontinuous 

funetion, g : LL ^ M. be a convex and (Frechet) differentiable function with ^-Lipschitz 
continuous gradient for /3 > 0 such that f + g is p-strongly convex for p > 0 and x* be the 
unique minimizer of f + g over Fi. Chose a, <5 G ( 0 , 1) and rj > 0 such that dftp < 1 and 

Let A : [ 0 , +00) —[ 0 , +00) be a locally absolutely continuous function fulfilling for 
every t G [ 0 , +00) 


0(t) := A(t) 

< m 


6 0 + (^ + 4p0a) 5 


^ ^ ^ + 4^ 

2p{l - a) 


0 + (;! + 4^) 1 


+ \\t) 


2p(l-a) 


/+ (:3 + 4 ^) F 


and such that there exists a real number A with the property that 


0 < A < inf X(t) 
~ t>o 
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and 


2<e := 


(:3 + 4 ^) 


-l-(5 


+ 


1 

4p/3^a 


1 

(5 


Further, let 7 : [0, + 00 ) ^ [0, + 00 ) he a locally absolutely continuous function fulfilling 
(USD and (EQD, uo,vo G Fi and x : [0, + 00 ) FI be the unique strong global solution of the 
dynamical system (1251) . 

Then ■y{t) > 7 := ^ 2 for every t G [0, + 00 ) and there exists M > 0 such that 

for every t G [0, + 00 ) 


0 < \\x{t) — x*|p < Wuq — X* 11^ exp (—(7 — l)t) H-- exp(—t) 


7-2 


< ||uo - 3;*ll + 


M 

7^ 


exp(—t). 


Finally, we approach the convex minimization problem Q via the second order dy¬ 
namical system 

/ x{t) +'y{t)x{t) + X{t)Vg{x{t)) = 0 . . 

\ x(0) = uo,x(0) = vo 

and provide an exponential rate of convergence of g to its minimum value along the 
generated trajectories. The following result can be seen as the continuous counterpart 
of [19t Theorem 4], where recently a linear rate of convergence for the values of g on a 
sequence iteratively generated by an inertial-type algorithm has been obtained. 


Theorem 9 Let g : FL ^ M be a p-strongly convex and (Frechet) differentiable function 
with ^-Lipschitz continuous gradient for p > 0 and fi > 0 and x* be the unique minimizer 
of g over Fi. 

Let a : [ 0 , -|-oo) —)• M 6 e a Lebesgue measurable function such that there exists a > 1 
with 


inf a(t) > max 
t>o 



(27) 


and A : [0,+oo) ^ [0,+cx)) be a locally absolutely continuous function fulfilling for every 
t G [0, -|-CK)) 

^<A(()<|(a(()+a=(t)). (28) 

Further, let 7 : [0, -|-oo) —)• [0, -|-oo) be a locally absolutely continuous function fulfilling 


1 _ 1 _ / 1 -|- 8 Alfi 

-- — < 7(i) < 1 + Oi{t) for every t G [0, -|-oo) (29) 

and (I 20 I) . 

Let uo,vo G FL and x : [ 0 ,-t-oo) FL be the unique strong global solution of the 
dynamical system ([26l) . 
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Then 7(t) > 7 := —^^ ^ and there exists M > 0 suc/i that for every t E 

[0, +00) 

0 < ^\\x{t) - x*|p < g{x{t)) - g{x*) < {g{uo) - 5((x*)) exp(-(7 - l)t) + — ^ exp(-t) 

Z “ 7 — z 


< 9(wo) - g{x*) + 


M 

7^2, 


exp(-t) < -^\\uo - x*|f + 


2 /S 


M 

^2 


exp(—i). 


Proof. One has for almost every t E [0, + 00 ) 


^ 9 {x{t)) = {x{t),Vg{x{t))) 

and (see Remark [T](b)) 

^g{x{t)) = {x{t),Vg{x{t))) + (x{t), ^Vg{x{t))^ < {x{t),Vg{x{t))) + ^\\x{t)f. 

Further, by using (|14p . (fTSll and the first equation in (|26l) . we derive for almost every 
t G [0, H-cx!)) 

^ { 9 {x{t)) - g{x*)) +'y{t)^{g{x{t)) - g{x*)) + a{t){g{x{t)) - g{x*)) 


dt'^ 


< - A(t)||V5((x(t))f + ^Po\\'^9ixit))f + 


1 


l®(^) + 


2/3p2 

2 Kt) 




a{t) 




2 ' 2/?p2 

Taking into account (l2^ we obtain for almost every t E [0, + 00 ) 


1 


+ 


^{g{x{t)) - g{x*)) + -i{t)j^{g{x{t)) - g{x*)) + a{t){g{x{t)) - g{x*)) 

lit) d 
2A(t) dt 


+ 


1 


X{t) a{t) 


2X{t )' 


iiv5(x(t))r <0. 


2 2/3p2 

According to the choice of the parameters involved, we have 

A(t) a{t) 


2/3p2 


> 0 , 


thus, for almost every t E [ 0 , +00), 


+ 


^{ 9 {x{t)) - g{x*)) +-f{t)-^{g{x{t)) - g{x*)) + a{t){g{x{t)) - g{x*)) 
X{t) d 


|S^WIP) + 


(l\t) 1 

V2A(t) /3 


2X{f) dt 

This shows that (|18p in Lemma [5] for u := ||x(-)|P 

bi{t) := a{t), 


< 0 . 
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and 


b2{t) := 


l{t) 

2\{t) 


bsit) := 


2X{t) 


1 


is fulfilled. By combining (I29p and the first condition in (j2ni] one obtains (jlGD . while, by 
combining (1290 and the second condition in (1201) one obtains (1171) . 

Furthermore, by taking into account the Lipschitz property of V (7 and the strong 
convexity of ( 7 , it yields 

pP<i. 


From (f28]l . (1^ and a > 1 we obtain 


—^ > 1 for every t E [0, + 00 ), 

p 


which combined with (j29p leads to 7 > 2. 

The conclusion follows from Lemma [5jii), the strong convexity of g and (I14p . 


Remark 10 In Theorem [9] one can obviously chose a{t) = a, where a = — 1, if 

/?/9 < 1, or a = 1 + e, with e > 0, otherwise, X{t) = X and 7 (f) = 7 for every t E [0, + 00 ), 
where 

« . , . f3 , 

2 


^ ^ \ ^ P / I 2\ 
j^<X<-[a + a) 


and 


1 + 1/1 + 87 


< 7 < 1 + a. 
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